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Abstract 

The effects of spike timing precision and dynamical behavior on error correction in 
spiking neurons were investigated. Stationary discharges — phase locked, quasiperi- 
odic, or chaotic — were induced in a simulated neuron by presenting pacemaker presy- 
naptic spike trains across a model of a prototypical inhibitory synapse. Reduced tim- 
ing precision was modeled by jittering presynaptic spike times. Aftereffects of errors 
— in this communication, missed presynaptic spikes — were determined by compar- 
ing postsynaptic spike times between simulations identical except for the presence or 
absence of errors. Results show that the effects of an error vary greatly depending 
on the ongoing dynamical behavior. In the case of phase lockings, a high degree of 
presynaptic spike timing precision can provide significantly faster error recovery. For 
non-locked behaviors, isolated missed spikes can have little or no discernible afteref- 
fects (or even serve to paradoxically reduce uncertainty in postsynaptic spike timing), 
regardless of presynaptic imprecision. This suggests two possible categories of error 
correction: high-precision locking with rapid recovery and low-precision non-locked 
with error immunity. 



1 Introduction 

This work is concerned with the effects of spike timing precision and dynamical behavior on the 
recovery of ongoing neural discharges after a perturbation, or an error. The concepts of "pre- 
cision" and "error" are of course intimately linked. Determining how information is transmitted 
among neurons is an essential issue in computational neuroscience, with a spectrum of possi- 
bilities, ranging from overall average firing rates to timing of individual spikes ( jPan et al., 19981 
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Lestienne, 200 Central to the question of where a presynaptic neuron's code lies in this spectrum 



is the precision of spike timing necessary to elicit a particular response from a postsynaptic neuron. 
This follows logically, as two different presynaptic discharges which produce the same postsynap- 
tic response have achieved the same functional result, and thus can be said to have carried the same 
message. 

The present paper addresses this issue directly by comparing recovery from errors in a spike 
train for two levels of spike timing precision. The goal is to test the feasibility of the idea that 
extra spike timing precision (in the sense that it is more than the minimum necessary to transmit 
a given amount of information) can be used for error correction. The errors that are used are 



missed spikes, based on the observed apparent unreliability of synaptic transmission ( |Katz, 1966 
Allen and Stevens, 1994). 



Examination of the effects of noise and jitter in spike trains on neural behavior goes back 
decades (Segundo et al., 1963rSegundo et al., 1968 ' Bryant e t al., 1973t[Segundo et al., 1976t|KoEn et al., 19811 



Kohn and Segundo, 1983g,Segundo et al., 1994bj . Briefly, the larger the number of input synapses 



(the smaller the effect of each presynaptic spike) and the smaller the correlation among them, 
the more their aggregate postsynaptic effect was like a DC bias. Greater correlations and fewer, 
stronger synapses operated more like single, strong synapses, producing reliably repeatable re- 
sponses in the postsynaptic cell. The effect of increasing noise on ongoing dynamical behavior 
in pacemakers was observed as steadily narrowing the input rate domains for phase locked be- 
haviors, abolishing those with narrower domains before those with broader ones. Consequently, 
periodic behaviors with broader domains in parameter space were more stable in the presence of 



noise. Later work showed this effect in rat spinal interneurons dBeierholm et al., 2001| ), and pre 



sented similar results for 1 : 1 alternation (the non-pacemaker counterpart of phase locking) with 



quasiperiodic driving (Tiesinga, 2002). 



Analysis of networks showed that coupling large numbers of cells could lead to lower output 
variability in the face of input jitter (Marsale k et al., 1997t Tiesinga and Sejnowski, 2001 1. Addi- 



tionally, periodic, phase locked dynamics were noted to be optimal for reduction of output jitter 
(the exception to this being near bifurcation boundaries, where input jitter could occasionally abol- 
ish locking) in network models (Tiesinga and Sejnowski, 2001 ). 

This paper investigates how timing precision in a presynaptic train interacts with the destruc- 
tion of information caused by a single neuron's internal dynamics. It extends previous work by 
evaluating both periodic and aperiodic (quasiperiodic and chaotic) postsynaptic dynamics, as well 
as the effects of proximity to bifurcations bounding periodic behaviors. Additionally, rather than 
simply examining the amount of perturbation produced by presynaptic errors, it also analyzes the 
time course of recovery. The ongoing presynaptic spike trains used here were stationary ones, with 
and without jitter, that induced a range of dynamical behaviors in the postsynaptic cell. Error re- 
covery was measured by the time course of return of the postsynaptic cell to its stationary behavior. 
This was determined by comparing pairs of simulations that were identical except for the presence 
of errors, so that after an error, the spike train of the postsynaptic cell could be compared to that of 
one that didn't see the error. Pairs of simulations were repeated for inputs with and without jitter, 
and error recovery was then compared in those two cases. 
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2 Methods 



A well-characterized physiological model (see Appendix) of the crayfish slowly adapting stretch 
receptor organ, or SAO, was used. In the living preparation, the SAO produces spike trains with 
rate broadly proportionate to muscle stretch; at constant stretch, it produces pacemaker spike 
trains. It includes the recognized prototype of a moderately-powerful, GABAergic inhibitory 
synapse, and thus has been used as a living model to explore synaptic coding across inhibitory 
synapses in general. The model has been used previously to explain the dynamics behind "para- 
doxical accelerations" observed in the living preparation ( |Segundo, 1979[ |Buno et al., 1987| l in 
response to pacemaker inhibitory PSPs (Segun do et al., 19^?Ta| [Segundo et al., 199 lb| ), as well as 
the SAO's responses to nonstationary spike trains ( [Segundo et al., 19^?^ [Segundo et al., 1993B[ 
[Segundo et al., 1995a[[Sti"ber et al., 19971 [Segundo et al., 1998[ ). 



Presynaptic spike train timing generation and analysis was performed in MATLAB ( [The Math Works, Inc.[ ). 
Simulation was performed using custom C code and the ODEPACK differential equation integra- 
tion library fHindm arsh, 1983[ ). Both pre- and postsynaptic spike trains were assimilated to point 
processes ( [Cox and Isham, 1980[ ) and all analysis was based on inter-event intervals. 

In the absence of presynaptic input, the SAO and its model behave as pacemakers, producing 
action potentials with an almost invariant interspike interval, A^: its natural interval. In the presence 
of pacemaker presynaptic trains, both exhibit a variety of dynamical behaviors, including phase 
lockings, quasiperiodicities, and chaos, with characteristic dependencies on the presynaptic rate 
([Segund o etal., 1991a[ [Segundo et al., 1991b[ [Stiber and Segundo, 19931 [Stiber et al.,T^ i. 

The current work began by building on previous works' survey of the dynamical behaviors 
exhibited by the model. Approximately 10,000 simulations were performed, varying both presy- 
naptic rate (N/I, I /I being the presynaptic rate for each simulation) and IPSP strength {P) within 
biologically plausible limits. This was used to produce an Amol'd map, or two-dimensional bifur- 
cation diagram, which categorized each simulation's dynamical behavior within the 2D {N/I,P) 
plane. Three values of P were then chosen for more detailed examination. These were dubbed 
"weak", "moderate", and "strong" IPSPs, based on the ratio of locked (periodic) to non-locked 
(aperiodic) behaviors they engendered (<20%, ~50%, and ^100%, respectively). For the current 
investigation, a moderate value of IPSP strength was chosen. 

A range of normalized presynaptic rates 0.2 < N/I < 2.0 was then explored using one-dimensional 
bifurcation diagrams. Here, such diagrams were constructed by plotting postsynaptic spike phase 
(cross interval from a postsynaptic spike back to the most recent presynaptic spike) versus N/I. 
These allowed easy determination of the distribution and organization of qualitatively different 
dynamical behaviors along the presynaptic rate scale (types of behaviors, behavior ranges, and bi- 
furcation locations). Each bifurcation diagram involved a set of 90-200 simulations, with diagrams 
produced for pacemaker and jittered pacemaker presynaptic spike trains. Values of jitter (w, see 
below) ranging from 0.01/ to 0.1/ (±1%-±10%) were examined; their bifurcation diagrams were 
similar overall. Results for ±1% jitter are presented here. This was viewed as a stricter test of the 
hypothesis (that high precision inputs would result in faster recovery from errors than low preci- 
sion, and thus the extra precision could be viewed as a type of redundant, error-correcting code) 
than larger values of w, as larger values would certainly result in the model's state being perturbed 
farther from the stationary attractors (and thus it would be a much shorter distance, therefore faster. 
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Figure 1: Simulation methods. Pairs of high {J^, J^g) or low precision spike trains were 

applied via the simulated inhibitory fiber (IF). Postsynaptic spike times were recorded for 
analysis. 



for the model to return to its attractor for high-precision input). Work on evaluating, in detail, the 
effects of varying level of jitter on error recovery are ongoing dStiber and Holderman, 2004b I. 

Four sets of 90-100 simulations used to produce bifurcation diagrams (high precision, low 
precision, and each with errors, see below) then served as a database describing error responses 
of the model. This communication focuses on the details of the model's recovery after an error 
and the effects of presynaptic spike timing precision on that recovery, and so a few illustrative 
behaviors were selected. The behaviors chosen are archetypical of the full range of dynamical 
behavior types exhibited by driven nonlinear oscillators: 1 : 1 locking (period 1), 1:2 locking 
(period 2), 2 : 3 locking (period 3, the longest periodic behavior for this model with significant 
extent along the N/I scale), two quasiperiodicities (low — N/I < 1.0 — and high — N/I > 1.0 
— rate), and chaos. An additional behavior was chosen to illustrate the effects of proximity to a 
bifurcation. A more complete examination of the global behavior of error correction (e.g., two and 
three dimensional bifurcation structure) is under way ( jStiber and Holderman, 200?a| ). 

For each example behavior, simulations involved generating two pairs of almost identical 
presynaptic spike trains, as schematized in Figure [T] For each set of simulations, a reference, high 
precision train, J^, with spike times {si,S2, ■ ■ ■ ,Sn}, was first generated. As this was a pacemaker 
train, all interspike intervals were identical (\/k,I = Ik = Sk — s^-i). I was the independent variable, 
chosen to elicit the example dynamical behaviors from the model. An error was defined to be com- 
plete failure of synaptic transmission, and so a set of spike numbers, = {^1,^2, • • -ikm}, was 
generated randomly such that all errors were separated by at least 15s (to allow the neuron to return 
to its stationary behavior before each error). Presynaptic spikes at times J^-^ = {^ytj j^ytj, ■■ - j^km} 
were eliminated from Jif to produce a high precision erroneous train, J^g = =^ — ^j^- 

A low precision counterpart of was generated by jittering each spike E by a value 
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Figure 2: Perturbation graph generation. The displacement of a postsynaptic spike after an error 
(bottom train) from the time of the corresponding spike in the situation where there was no error 
(top train) is plotted versus time since the error. 

taken from a uniform distribution with range ±wl. In the current communication, a small value of 
w (w = 0.01, 2% jitter) was used. 

The result of applying this jitter was a low precision train =Sf = {si + ui,S2 + U2, ■ ■ ■ ,Sn + u„}. 
A low precision erroneous train, = ^ — =Sfj^, was then produced by eliminating the spikes 
numbered at times = {ski+ .Sk^ + Uk^, ■ ■ ■ , Sk,„ + Wyt,„ } • Subsequent analysis involved 
pooling timing data for postsynaptic spikes near errors in these sets of four simulations. As a 
double-check, multiple simulations were run for each set of simulation parameters (with different 
realizations of {uk}) and analysis performed on the pooled data from all; as might be expected, 
there was no difference in results for m errors taken from n simulations versus m errors taken from 
a single simulation. 

As Figure|2lillustrates, the first step of analysis was based on comparing times of postsynaptic 
spikes ^ = {...,?,_!,?,,.. .} just before and after the error times for the erroneous and error-free 
cases. For each error kj G J^, j = 1 , 2, . . . , m, the set of c postsynaptic spikes just before and after 
were selected (here, 5 spikes before and 25, 30, or 45 spikes after — depending on the rate of 
production of postsynaptic spikes and the recovery time — and thus c was 30, 35, or 50). These 
spike times can be renamed relative to the error number j as {?j,i,?j,2, • • ■^tj,c} (bottom train in 
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Figure 3: Recovery plot construction. A pair of corresponding high and low precision perturbation 
graphs (top) are subtracted to produce perturbation differences; the recovery plot is the plot of the 
range of differences, A^. 



figure). For each postsynaptic spike in the erroneous case, {tj^g}, j = 1, 2, . . . ,m, g = 1, 2, . . . ,c, 
the cross interval back to the most recent postsynaptic spike in the error-free case (top train in 
figure), Yj,g, was computed. As the simulations involve an inhibitory synapse, the number of 
postsynaptic spikes in the erroneous case was always greater than or equal to the number in the 
error-free case; this was the reason for using the former spikes as the reference for computing „. 
This was done for each pair of high and low precision input simulations to yield \}/fL and i//^, 

respectively. Thus, i//ff and y/f^ measure the shift, or perturbation, of each postsynaptic spike 
from the time it would have occurred if there had been no error. The graph of {tj^g — Skj, wfg) 
{tj_g — Sk- — U]^., wfg)^ such as in Figure|5tA), was termed a perturbation graph. 

In every case, the perturbation graph compares a simulation (either high or low precision) with 
errors to the identical (canonical) one without errors. Therefore, any scatter of points is due to 
either the simulation accuracy (which, for lockings at least, can be judged by the points before 
the error time) or the presence of errors themselves. Jitter, in and of itself, did not produce any 
scatter because each presynaptic spike in both simulations occurred at identical times in identical 
simulations (neglecting errors). Perturbation graphs show only the effects of errors and possible 
interaction of errors with the presence of jitter. 

The high and low precision perturbations, yff and yff„, were compared in recovery plots. 
Figure|3]illustrates how such plots were generated. For each pair of cross intervals, the difference, 
^hs ~ v fs ~ vfs' computed. Because of the variation in the individual error responses in the 
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low precision case (the scatter of points in the perturbation plot), 5j^g typically took on a range of 
values for each g. Rather than examine the average difference, the decision was made to compute 
the range of differences, Ag = msix j{dj^g) —mmj{5j^g). A difference 5j^g = indicated that the 
high and low precision perturbations, for that particular error j and postsynaptic spike g, were 
identical. A range Ag = indicated that, for all errors, the perturbation of postsynaptic spike g 
was the same for high and low precision — that low precision input did not have an effect on the 
perturbation. Thus, a range Ag > indicated that some low precision perturbations differed from 
high precision ones. In other words, because these were simulations, none of the postsynaptic 
spikes were considered outliers. As an alternative, the variance of 8j g (for each value of g) could 
have been used; in practice, it produced equivalent results. So, a recovery plot such as in Figure |4| 
is a graph of Ag versus the mean offset eg = tj^g — s^j, for each value of ^ = 1 , 2, . . . , c. It collapses 
the g^ set of perturbations to a single point and compare high and low precision perturbations, 
showing the time course by which the worst low precision error responses approached those for 
high precision. 

The primary motivations behind the use of recovery plots were easier analysis of the time 
course of recovery than perturbation graphs and elimination of the need to compare pairs of per- 
turbation plots by eye to evaluate the effects of low versus high precision. Assuming the erroneous 
simulation fully recovered before each error, the values of Ag for Cg < can also serve to test 
whether low precision responses were still significantly perturbed. Comparing Ag for Cg < for 
different simulation parameters allows one to judge whether the simulation was recovered. 

To characterize the ongoing dynamical behavior exhibited by the SAO, cross intervals between 
the pre- and postsynaptic times, and respectively, were used. Since was a pacemaker 
process, the cross intervals = ti — s^ from postsynaptic spikes back to most recent preceding 
presynaptic spikes were termed phases ( |Winfree, 1980t Glass and Mackey, 1988 ). The phase re- 



turn map, plotting ((^,-, ^,_|_^), trivially indicates p : q locking since 0, = <^i+q. Quasiperiodic re- 
sponses produce a ID curve without a maximum for q = \, while chaotic behaviors have return 
maps with maxima or that are not one-dimensional curves ^Abraham and Shaw, 1984HRapp et al., 1985[ 



Ruelle, 1989| ). For brevity's sake, return maps are omitted from the Results section for phase lock- 



ings. 

3 Results 

In this section, error recovery during locked, quasiperiodic, and chaotic responses is considered. A 
final subsection examines the effect of proximity to a bifurcation boundary on error recovery. 

3.1 Phase Lockings 

In previous work on both the SAO and this model, phase locked responses were found to be the 
most robust in the presence of nonstationary presynaptic spike trains, with 1 : 1 locking being the 
most robust among lockings ( |Segundo et al., 19^ [Segundo et al., 1991^ [Segundo et al., 1993B 



Segundo et al., 1995a||Segun do et al., 1998 ; "Stiber et al., 1997]). This has also been noted in other 



preparations and simulations (Beierholm et al., 2001t|Tiesinga and Sejnowski, 2001[|lTesinga, 2002 ) 
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Figure 4: Results for center of 1 : 1 locking (/ = 108.78ms, N/I = 0.96). High precision perturba- 
tion graph (A) shows identical responses to all errors; low precision (B) shows range of responses. 
Recovery plot (C) shows long-duration recovery, (m = 49 errors, c = 25 spikes/error) 
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Figure 5: Results for 1 : 2 locking (/ = 227.01ms, N/I = 0.46). Perturbation graphs for high (A) 
and low (B) precision input and recovery plot (C) all carry mark of the two categories of phases, 
(m = 49errors, c = 25 spikes/error) 



Thus, analysis began with these behaviors in the expectation that they would exhibit the greatest 
immunity to low precision jitter and the fastest error recovery times dStiber, 2003! ). 

Figure|4|presents typical results for 1 : 1 locking. For high precision input, the response to every 
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error was identical (A), with a maximum perturbation of approximately i//f^ = 5.25ms. For low 

J ?o 

precision (B), the maximum perturbation was x^f-f ~ 6ms, with up to a 1.2ms range for any single 
value of g. An exponential fit for the points in the recovery plot (C) in the range 0.4 < eg < 0.9 
yielded a recovery time constant of T = 0.20s (t// = 1.84), with a slower recovery proceeding 
thereafter. This is the rate at which the "worst" low precision error responses approached that for 
high precision. Low precision responses were still significantly perturbed 2s after an error. 

Perturbation graphs (A, B) and a recovery plot (C) for 1 : 2 locking are shown in Figure |5] 
Note that the points occur in pairs, with small differences between the pairs of points leading to 
the appearance of oscillations in the recovery plot. These correspond to the pairs of postsynaptic 
spikes that occur between each pair of presynaptic spikes (two categories of cross intervals). As 
with 1 : 1 locking, all responses to errors for high precision input were identical (A); the maximum 
perturbation in this case being 19ms. Low precision (B) maximum perturbations ranged from 
about 17ms to 20ms. The recovery time constant for 0.51 < eg < l.OS was T = 0.27s (t// = 1.19). 
Recovery slows down considerably after eg = 1.2s, at about ten times the pre-error difference 
range. 

As Figure |6t A) shows, 2 : 3 locking, unlike the previous lockings, exhibited some variability 
even in its high precision response to repeated errors — qualitatively similar to low precision 
simulations, though much smaller. Note the linear scale in graphs (A) and (B). The maximum high 
precision error perturbation was around 24ms with a 1ms spread; for low precision, this was 27ms 
with a 5ms spread (ignoring bimodality; see below). In both cases, there were triplets of clusters, 
corresponding to the three postsynaptic spikes occurring for each pair of presynaptic spikes (i.e., 
this was a period-three behavior). Differences among the three categories of cross intervals explain 
what appear to be oscillations in the recovery plot (C), as with 1 : 2 locking. Clusters had a bimodal 
distribution of perturbations, with some small (around 0-2ms) and some large. The recovery plot 
shows an initial peak at less than an order of magnitude more than the pre-error value, a slow 
recovery until around eg = 2.5s; there were additional, lower peaks after 2.5s (before eventual 
return to pre-error values, as indicated by the points before the error). The range of differences 
before the error (eg < 0) was on the order of 1ms, compared to 2-5 /is for 1 : 1 and 1 : 2 lockings. 



3.2 Quasiperiodicities 

A quasiperiodic behavior is one in which the phase of the response shifts with respect to the 



stimulus, eventually taking on any value within some range ( |Ermentrout and Rinzel, 1984| ). This is 
made apparent by the phase return map in FigureHA), which is a one-dimensional curve covering 
the range 0-/. Note that a phase of zero is equivalent to one of /, so the graph corresponds to a 
torus and the curve is not discontinuous. There was no apparent qualitative difference (and little 
quantitative difference) between high (B) and low (C) precision error responses; if anything, there 
was even a slight decrease in postsynaptic spike timing variability after an error. This is especially 
apparent in the recovery plot (D), with a maximum range of / before an error and a minimum 
range (ignoring the high frequency "oscillations" every third spike — the "ghost" of the nearby 
2 : 3 locking) of around 95ms at eg ^ Is. 

Figure m presents results for a high-input-rate {N/I > 1) quasiperiodicity. As can be seen 
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Figure 6: Results for 2 : 3 locking (/ = 168.43ms, N/I = 0.62). Both high precision (A) and low 
precision (B) perturbation graphs show ranges of responses to different errors. Recovery plot (C) 
shows reduced, long-duration error aftereffect, (m = 49 errors, c = 25 spikes/error) 



in the phase return map (A), the model only fired within a relatively restricted range of phases, 
approximately 59-63ms after a presynaptic spike. This is an example of a windowed behav- 
ior ( |Segundo et al., 1991a l, in which the postsynaptic cell is only able to fire within some narrow 
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Figure 7: Error responses for quasiperiodic behavior near 2 : 3 locking (/ = 174.04ms, N/I = 0.60). 
Phase return map (A) is a ID curve. High precision (B) and low precision (C) perturbation plots. 
Note linear Y axis for recovery plot (D). (m = 49 errors, c = 25 spikes/error) 
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Figure 8: Error responses for windowed quasiperiodic behavior (/ = 63.67ms, N/I = 1 .64). Phase 
return map (A) is a ID curve. High precision (B) and low precision (C) perturbation plots. Note 
linear Y axis for recovery plot (D). (m = 49 errors, c — 25 spikes/error) 
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Figure 9: Chaotic behavior (/ = 56.14ms, N /I = 1.86). Phase return map (A) is not a ID curve. 
High precision (B) and low precision (C) perturbation plots. Note linear Y axis for recovery plot 
(D). (m = 49 errors, c = 25 spikes/error) 



time. Both high (B) and low (C) precision had a spike timing variability of around 3ms before an 
error, with a peak perturbation of 28ms and perturbation range of about 8ms after an error. The 
range of differences (D) was less than doubled by an error, with an oscillatory recovery with period 
a bit over Is and apparent complete recovery after 4s. 

3.3 Chaos 

Figure 13 shows the error responses for a high-input-rate chaotic behavior. The phase return map 
(A) is "braided;" clearly not a ID curve. The neuron could fire between and 56ms (/) after a 
presynaptic spike, with a postsynaptic interval range of 139-155ms and mean of 148ms. So, this 
response was not windowed. As with the low-input-rate quasiperiodic behavior, there was little 
difference between high (B) and low (C) precision responses — in both cases, postsynaptic spike 
timing variability decreased after the error. There was perhaps a slight increase in the recovery plot 
(D) after an error, with subsequent decrease and increase again, but this was not dramatic. 

3.4 Bifurcation Boundaries 

The earlier locking examples were chosen to lie within the middle of the range of presynaptic rates 
that elicited the behavior. For input rates near an extreme presynaptic rate, different results were 
found. This is illustrated in Figure [TOl for an input near the low rate bifurcation point bounding 
1 : 1 locking. As in the middle of the range, high precision inputs (A) elicited the same response to 
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Figure 10: Results for edge of 1 : 1 locking (/ = 133.88ms, N/I = 0.78). High precision perturba- 
tion graph (A) shows identical responses to all errors; low precision (B) shows range of responses. 
Both differ from farther away from the bifurcation (Figure |4|). Recovery plot (C) shows greatly 
extended recovery, (m = 49 errors, c = 25 spikes/error) 
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every error, with a maximum perturbation of almost 60ms. For low precision inputs (B), maximum 
error perturbations were between 55ms and 60ms. Unlike the previous 1 : 1 example, the peak 
perturbation was reached slowly — after three postsynaptic spikes — and the recovery was more 
gradual (C), with a broad secondary peak around Cg = 1.5s and a value still about two orders of 
magnitude greater than that before the error at = 2.5. 

4 Discussion 

This paper has examined the interaction of neuron dynamics and spike timing precision in error 
correction in a model of the living prototype of an inhibitory synapse and postsynaptic neuron. 
The dynamical behaviors included locked, quasiperiodic, and chaotic; additional issues, such as 
proximity to bifurcation points and windowing, were touched upon. All analysis was based on 
spike times and interspike intervals, rather than state space analysis. This is especially significant, 
in the author's view, because that is exactly the message that neurons transmit to each other. Thus, 
variations seen here are at least potentially significant (as opposed to changes in internal state that 
might have no impact on spike timing). 

It is important to remember that, in all cases, high precision erroneous simulations were com- 
pared to high precision error free ones and low precision erroneous simulations were compared to 
low precision error free. Thus, when a recovery plot was generated, values larger than those just 
before an error showed that at least some low precision responses were significantly farther away 
from "full recovery" than the high precision ones. 

Among all behaviors examined, phase lockings produced the most rapid recovery, with lower 
ratios that occur in broader rate domains (1:1 and 1 : 2) recovering faster. One reason for this 
likely was the gradient of the attractor basin surrounding such behaviors. During the acceptably 
exponential phase of their recoveries (roughly from 0.5s to Is after an error), 1 : 1 and 1 : 2 locking 
had similar time constant (0.20s and 0.27s), despite the fact that their associated presynaptic rates 
differed by more than a factor of two. The conclusion is that, at least for that phase of error 
recovery, it was not the case that each presynaptic spike simply corrected the error by some amount 
proportional to the perturbation. Rather, the gradients of the two basins of attraction — at least at 
those distances from the attractors — were similar. Based on computed recovery time constants, 
the worst case low precision recoveries had significantly longer recovery times — on the order of 
seconds longer. 

For 2 : 3 locking and all nonlocked responses, the "excess perturbation" of low precision ver- 
sus high precision (the peak of the recovery plot) was much less than for the lower ratio locked 
behaviors. In fact, for 2 : 3 locking, it was roughly a factor of five greater, while for all nonlocked 
behaviors it was less than a factor of two. There were two possible mechanisms underlying this: 
a narrow rate domain that elicited the particular behavior and desynchronization of erroneous and 
error free responses by errors. 

The first matter, that of domain width, was especially relevant to 2 : 3 locking. As can be seen 
by comparing Figure |5tC) to Figures EtC) and|5tC), the peak was not too different than the lower 
ratio lockings; the difference was the degree of perturbation before the error (more than two orders 
of magnitude higher in the case of 2 : 3 locking, roughly at the level of the added low precision 
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jitter). This was probably caused by the jitter in the low precision simulations bumping the state 
out of the locking behavior (Beierh olm et al., 200 It [Tiesinga and Sejnowski, 200T) ), causing the 
two low precision simulations to remain partially desynchronized — they were, at least part of 
the time, away from the synchronizing effect of the periodic attractor (see discussion below of 
bifurcation boundary transitions). 

That was a "minor" desynchronization effect, because there was a periodic attractor which 
tended to pull the erroneous and error free simulations' states back together. Such was not the case 
for aperiodic behaviors. In those cases (quasiperiodicity and chaos), once the neuron had been 
perturbed by the first error, returning to the attractor did not bring its subsequent spikes back to 
the same times they would have occurred in the absence of the error. This was the case for both 
high and low precision. For the quasiperiodic cases (Figures |7]and[Hl), there were "preferred" firing 
intervals (where the phase return map was closest to the diagonal in both figures, and additionally 
due to windowing itself for windowed quasiperiodicity). The closer the quasiperiodicity came to 
being periodic (the more dominant the preferred firing intervals were), the more it would act to 
resynchronize the erroneous simulation with the error free one. 

For Figure 121 this was not very close at all (about 25ms), the erroneous and error free exper- 
iments were completely desynchronized by the first error, and as a result their "perturbations" in 
Figures HB) and (C) before the error could be as large as the full range of possible phase differ- 
ences {1/2). Additionally, the high and low precision cases thereafter were also decorrelated, and 
so the range of their perturbation differences in (D) was the sum of their maxima. However, in both 
the high and low perturbation cases, errors arrived at approximately the same time (within ±wl of 
each other), and so the errors paradoxically served as a partial resynchronizing input, as indicated 
by the decrease in (D) after the error. 

Windowed quasiperiodicity, however, behaved more like a weak locking. As Figure [5] shows, 
the neuron was constrained to fire within a 4ms window relative to an input spike when station- 
ary (A), which was much less than the 25-30ms perturbation induced by an error (B, C). As a 
result, the cell exhibited an oscillatory recovery, with high precision input being somewhat more 
effective (D). 

Chaos, by definition of its hallmark sensitive dependence on initial conditions, was the ex- 
treme case of these desynchronizing processes, with the jitter of low precision leading those cases 
to diverge rapidly from high precision and the presence of errors having a similar effect between 
erroneous and error free experiments. As Figure |3D) shows, error aftereffects were qualitatively 
similar to (though perhaps more extreme than) that for quasiperiodicity in Figure ITJ^D), with the 
similarly-timed errors affecting the high and low precision erroneous experiments in similar fash- 
ion. 

The final results in Figure [10| address the issue of proximity to a bifurcation boundary. This is 
also relevant to the effects of domain width and similarity or dissimilarity of attractor basins and 
attractors on error recovery. In both the high and low precision cases, in the absence of errors the 
neuron's state was on or near a period-one attractor at all times (the jitter was not large enough 
to destroy locking, as was verified by examination of the phase return map for the low precision 
case). Unlike the simulation in Figured however, the perturbation produced by an error did not 
displace the state into the basin of another 1 : 1 locking. Instead, the perturbation moved the state 
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across the bifurcation boundary into the basins of qualitatively different attractors, and its motion 
thereafter was very different than that of recovery exclusively through period-one attractor basins. 

This raises an important point regarding the nature of the perturbation produced by an error. 
Because the presynaptic intervals served as a control parameter, errors were not merely perturba- 
tions of the neuron's state within its state space, E C IR". Instead, they were perturbations within 
the system's response space, / x E ( |Thom, 1975t [Abraham and Shaw, 1984| ). The perturbation of 



an ongoing behavior near a bifurcation boundary or within a narrow domain (such as in Figures |^ 
[rot displaced the neuron's state across domains of different behaviors. After the perturbation, the 
re-established sequence of spike times drew the neuron through its response space and back across 
(possibly multiple) bifurcations into basins of attractors qualitatively like its "home" (stationary 
attractor). Its evolution, however, because of these dissimilar basins, didn't necessarily lead it to- 
ward the region of E that contained this home. As a result, the perturbation and recovery plots 
could show multimodal, or oscillatory, shapes. 

Having established that even a small amount of spike timing jitter can have observable ef- 
fects on the time course of error recovery (and potentially on the activity of further postsynaptic 
neurons), subsequent work is progressing along a number of fronts: 



A more complete model of the bifurcation behavior of error recovery ( [Stiber and Holderman, 2004a I 
is being developed. Rather than using some property of the stationary behavior of a dy- 
namical system, one can examine how properties of transient neural responses depend on 
pre-existing stationary behaviors. 



The role of degree of spike timing accuracy on error is being investigated ( [Stiber and Holderman, 2004b I 



The current results show that even small amounts of jitter can have a significant effect on er- 
ror recovery. The amounts used here were in the range of l-4ms or so, and thus are relevant 
to a range of biological systems, based on observations (for multiple spike trains) of correla- 
tions and correlation-dependent activity in retinal ganglion cells and lateral geniculate cells, 
and are at the low end for some cortical cells ( [Bair, 1999[ ). Preliminarily, order of magnitude 



jitter increases in general produce similar effects, though, as might be expected in a nonlinear 
system, linear increases do not appear to produce linear changes in recovery. 

The transient response of this model is being examined in terms of its internal state variables 
( Stiber and Pottorf, 2004| ), as a preliminary to developing a simplified model that captures 



the error responses and is more amenable to analytic approaches. Early results suggest that 
spike rate adaptation is the most significant contributor to the observed error responses. 

A final matter is that of the application of Shannon's information theory to coding by nonlinear 
dynamical neurons. Techniques from the field of information theory ( [Shannon, 1948[ [Cover and Thomas, 1991 1 



are currently of great interest in addressing the question of what spike trains can be said to carry 
identical information ( [Bialek et al., 199ll[Borst and Theunissen, 1999l[Fuhrm ann et a l., 2002[ ), and 



thus whether the timing of individual spikes or average firing rate is relevant. Entropy calculations 
can be quantified in terms of bits of information per spike — a compelling statistic. The typical ex- 
perimental approach is to present a stimulus multiple times and use the "average" response (where 
this averaging might be accomplished in varying ways) to compute entropy or mutual information. 
This is then used to infer characteristics of the neural code (e.g., rate versus time codes). 
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It is important, however, to remember that information theory tells one nothing about the se- 
mantics of a code ( [Shannon and Weaver, 19491 ). Primarily, and in conjunction with knowledge of 



the noise in a communication channel, it addresses issues of information capacity: how close to 
optimally compressed a signal is. This part of Shannon's work — the Noisy Channel Coding The- 
orem — is usually used in neuroscience only in terms of estimating "channel noise" from multiple 
presentations of the same stimulus. However, another application of this theorem is the creation 
of codes that use more bits (symbols, or in the context of neural coding, greater spike timing 
precision) than the required minimum to provide for error correction in the presence of channel 
noise. 

As these results clearly show, both the quantitative and qualitative results of a presynaptic error 
depend critically on a neuron's internal state's ongoing evolution. It is a mapping / :/ xE^OxE, 
from input and state to output and new state. This suggests that the computation performed by 
a neuron will inevitably result in a decrease in mutual information between its input and output. 



according to the Data Processing Theorem ( [Shannon, 1948,.Cover and Thomas, 1991J . In contrast. 



Shannon's formal definition of an encoder or decoder is a stationary mapping f : A* ^ B* from 
input sequences of symbols taken from some set A to output sequences of symbols from some 
(possibly different) set B. In other words. Shannon's information theory applies when the encoding 
of an input symbol depends only on its context within the sequence of input symbols. On the other 
hand, for a nonlinear dynamical system, output depends on input and state, where state is not 
merely a function of input but also of intrinsic dynamics. Therefore, Shannon 's information theory 
is conceptually incompatible with neural information processing. In practical terms, this implies 
that information theoretic techniques can only be used to establish lower bounds on matters such 
as spike timing precision. 

A SAO Model Equations 

The SAO model equations used here are documented more completely in dEdman et al., 1987 



Stiber et al., 1997|); the following is a brief summary. It is a permeability-based, rather than 



conductance-based, model with the following main equations: 



dVm/dt = -{lNa+lK+lL,Na+IuK + lL,a+Ip+hias+Isyn)/Cm (1) 

/ = AP m^hl ^"'^^ [Na+].- [Na+].expFV„/i?r 
RT l-expFV^/RT 

RT 1-expFVjRT 
J = AP ymF^X]o-[X],cMFV^/RT) 

^'^ ^'^ RT l-exp{FV,n/RT) ^ ' 

AF J„ hln 

h = —- ^^^^^ (5) 

'Y _|_ K.m 
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'^syn 



V F' 



[cr]o-[cr]itx^{-FVm/RT) 



syn 



RT 



,{sk-t)/T:+ 



l-cxp{-FV^/RT) 



(6) 



Table 1 : Constants used in this simulation, in rough order of 
appearance in equations in this appendix. 



Constant 


Value 


Units (MKS) 


Cm 


7.5 X 10""^ 


Farads 


^bias 


-2.5 X 10"^ 


A 


A 


1.0 X 10"^ 




PNa 


6.0 X 10^ 


m/s 


[Na+]o 


325.0 


mM 


[Na+j; 


10.0 


mM 


T 


291.15 


°K 


Pk 


2.0 X 10^ 


m/s 


[K+]o 


5.0 


mM 


PL,Na 


5.0x lO-i*^ 


m/s 


Pl,k 


1.8 X 10^ 


m/s 


Pl,ci 


1.1 X 10-'^ 


m/s 


[cr]o 


650.0 


mM 


[cr]i 


46.0 


mM 


J p,Na 


6.0 X 10-^ 


mol/(m^s) 


Km 


13.4 


mM 


Psyn 


6.0 X 10-^ 


m/s 




0.25 X 10-3 


s 


T_ 


0.5 X 10-3 


s 




0.0 


dimensionless 


yh 


0.0 


dimensionless 


V/ 


0.0 


dimensionless 


Vn 


0.03 


dimensionless 


Vr 


0.5 


dimensionless 


Zm 


-3.1 


dimensionless 


Zh 


4.0 


dimensionless 


zi 


3.5 


dimensionless 


Zn 


-2.6 


dimensionless 


Zr 


4.0 


dimensionless 


Vm 


-19.0 X 10-3 


V 


Vh 


-35.0 X 10-3 


V 


Vi 


-53.0 X 10-3 


V 


Vn 


-18.0 X 10-3 


V 



19 



Table 1 : Constants used in this simulation, cont'd. Note that 
the Vm here is the voltage associated with the m gating vari- 
able, not the membrane potential. 



Constant 


Value 


Units (MKS) 


Vr 


-56.0 X 10^^ 


V 




0.3x 10"3 


s 


T/, 


5.0 X 10-3 


s 




1700.0 X 10^3 


s 




6.0 X 10-3 


s 




2000.0 X 10-3 


s 



Values for constants are given in Table[Tl Besides active and leak Na+, K+, and CP currents, 
there is a bias current {luas)^ generated in response to muscle stretch, an active pump (/p), and a 
synaptic current {Isyn)- There are five gating variables, m, h, I, n, and r, with first-order kinetics 
described by dTj-fTOI) (where g G {m, Z, n, r}). 



dg/dt 



{g^-g)^ 



Vg + 



1-v, 



Qg = 



exp 


kT 


/I - 




V 4 ; 



+ exp 



kT 



+ 



1-5, 



8,-1 



(7) 
(8) 
(9) 

(10) 
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